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Nowadays, Agile software development practices are being widely adapted 
all over the world. Scrum is one of the most known Agile models, it satisfies 
the business needs and put the main focus on the product. One common 
challenge for the development of customer-facing products is having a good 
user experience. This paper presents integrating Scrum development process 


with user experience design flow. In this study, papers relating to the topic 





of user experience (UX) process integration with Agile development process, 
Keywords: how to measure it and how to improve it, from the year 2010 onwards 
Agil are reviewed. This is to identify how organizations can integrate UX design 
gre flow and Scrum development and get the benefits of both. The conducted 
review identifies a number of limitations in the existing integrations efforts. 
A proposed process model to resolve these limitations is presented. Along with 
our experience in implementing it on an ongoing software development 
project. The results of applying this process, its impact on the project 
outcomes quality and the employees’ satisfaction with the process are discussed. 
The goal of this study is to aid organizations in integrating UX design into their 
development process. 


Scrum 
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1. INTRODUCTION 

Nowadays, Agile software development practices are being widely adapted all over the world [1]. 
This rapid adaption is due to agile methodology’s ability to accommodate the current business needs. 
These business needs include rapid response change and a lower software development cost which can be 
achieved through Scrum model [2]. Scrum is one of the most known Agile models, it satisfies the business 
needs by aggregating the different developers’ roles into cross functional Scrum teams [3]. Scrum merges 
the well-known development activities of gathering the requirements, designing the system, developing it 
and testing [4] into a minimal set of activities. Using Scrum has multiple advantages as it aligns the team, put 
the focus on the end product, and provide stakeholders with visibility on the project and the iterations it goes 
through. 

Also, Scrum allows for a faster time to market [5] one requirement the business often have when 
the software is facing customers is the ease of use. Analyzing and designing the product for ease of use are 
often referred to as user experience (UX) design. UX designers work on studying the users’ behaviors and 
needs then designing the software to make it easy to use and delightful for the users [6]. To do this they 
consider the users’ feedback to address their satisfaction and increase it [7]. This includes the studying 
of their emotions [8] and mental model [9]. Companies are trying to address the user needs by integrating 
the UX design and making it part of developing their software. This led to UX designers being part 
of the Scrum team and needing to work within the sprints’ time-box. However, UX design is very much 
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a linear process which makes it hard to deliver a software that adhere to the best UX practices in a short 
time-boxed sprint and in an iterative manner [10]. The integration between UX and development sprint often 
caused clashes between their processes and lead to compromising on either quality or time. There is an 
identified lack of ideal process to integrate UX process and activities with the agile methodology [11]. UX 
design and Agile development are often needed together as the business need to delight the users and to ship 
the product faster. However, the different approaches and focus in the two processes makes it challenging to 
deliver the desired benefits together [12, 13]. Multiple researchers have looked into integrating UX process 
with Agile development method. However, organizations still face a challenge when trying to choose 
and implement the best integration method. This paper presents integrating Scrum development process with 
UX design flow. A systematic review is conducted, followed by proposing a model to improve 
the integration and a case study for the proposed model. The aim of this study is to identify the challenges 
faced in the integration of the processes and identifying methods to resolve them. 


2. LITERATURE REVIEW 

This paper follows a systematic review process of the current work on integrating UX process with 
Agile development methodology, mainly Scrum model. Identifying the papers to be considered on the review 
was based on keywords using digital libraries. The keywords chosen are Agile & User Experience, Scrum & 
User Experience, HCI & Agile or HCI & Scrum. The publication date for the papers is from 2010 onward. 
This is to answer the review questions: What practices are currently being used? What challenges faces 
practitioners? What are the proposed or tried methods to resolve them? Are the current processes adequate? 
A total of 14 papers are identified for this study. They are organized under 3 main categories as shown in 
Table 1: reviewing the current state of the field, proposing a process model or proposing an evaluation 
technique. The papers in each of the 3 previously mentioned categories were analyzed to answer the research 
questions. We discuss each of these categories in the following sections. 


Table 1. The papers reviewed 








Paper title Year Category 

Measuring effectiveness of HCI integration in software development processes [14] 2010 = Proposing-Evaluation technique 
User experience design goes Agile in lean transformation-a case study [15] 2012  Reviewing-Case study 

Agile development and user experience design integration as an ongoing achievement in 2012 Reviewing-Case study 

practice [16] 

Agile user experience development in a large software organization: Good expertise but 2012 Reviewing-Case study 

limited impact [12] 

Applying lean startup: An experience report-Lean & lean UX by a UX Veteran: Lessons 2012 Reviewing-Survey 

learned in creating & launching a complex consumer app [17] 

Lean UX-The next generation of user-centered Agile development? [10] 2014 — Proposing-Model 
AGILEUXModel-Towards a reference model on integrating UX in developing software 2014 = Proposing-Evaluation technique 
using Agile methodologies [18] 

The prevalence of UX design in Agile development processes in industry [19] 2015 Reviewing 

Overcoming challenges in Agile user experience work: Cross-case analysis of two large 2015 Reviewing-Case study 


software organizations [20] 
Integrating user-centered design practices into Agile web development: A case study [21] 2016 Reviewing-Case study 


Integrating UCD into Scrumban for better and faster usability design [22] 2017 Proposing-Model 
UXUP-user eXperience centric unified process [23] 2018 — Proposing-Model 
Agile UX: Integrating good UX development practices in Agile [24] 2019 — Proposing-Model 
Integrating UX principles and practices into software development organizations: 2019 Reviewing-Case study 


A case study of influencing events [25] 





2.1. Reviewing the current state of the field 

Multiple researchers tried to identify and address the challenges posed by integrating UX workflow 
and Scrum development. Each of them took a look at the integration challenges from a different angle. 
One cross case analysis [20] identified and addressed some of the challenges in integrating UX work 
and the development process. The researchers looked at two large software companies to address 
the challenges they faced. The highest challenge they faced is identifying and addressing the users’ needs, 
followed by team alignment and managing the project big picture. As a result of their study they suggest 
including the UX specialist in the development team. More of the challenges related to the integration 
are identified in study [19]. It looked at the industry and the gaps between UX methods adapted by 
practitioners and what is being studied in academia. The focus was on identifying the methods used 
and challenges faced by practitioners. This was done by interviewing 8 companies twice. The interviews 
showed that 71% were using Scrum development process. On the other hand, 41% of the companies had UX 
work integrated in the Agile framework. The researchers suggested 2 approaches for integrating UX work 
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into the agile framework. The first is training developers and letting them do the UX work. The second 
is altering the UX process to be more fitting with the development. 

Another study [17] focused on reporting the practices adapted by organization workers relating to 
the integration of UX. The participants were developers and designers. Through this study they identified key 
points relating to the success of the integration. The mentioned points were relating to the behavior aspect 
which includes setting expectations of accepted behavior, mutual awareness and engaging with the other 
workers, and progress negotiating. 

Moreover, multiple case studies in the topic were conducted. An empirical investigation of 
the integration of user centered design into the agile process for web development [21]. They conducted 
a case study with postgraduate students to evaluate the effectiveness of their proposed model. The case study 
showed an increased ability to detect and close defects faster. However, they faced a limitation in evaluating 
the effectiveness of the UX process due to the participant’ limited experience with the required activities. 
Also, an explorative study [12] conducted a present state analysis concentrating on UX within Agile software 
development in a large software organization. They identified how the ineffective integration process 
negatively impacted the performance of the team which was mature in both areas but integrated wrongly. 

Another case study [25] followed a group of practitioners for 15 months to understand their work 
and identify ways to help startups that want to adapt an agile process and integrate UX into it. The identified 
5 main recommendations which are: to consider advices carefully before applying those, pay attention to UX 
work, be carefully when choosing technologies, optimize the development process and the team skills, 
and the last point is to test often and early. As time plays a factor in the integration one case study [16] 
focused on studying the changes in UX integration over time within an organization. They have identified 
the types of events overtime that affects the integration. These events could be categorized based on them 
being internal, direct, planned or the opposite. The challenges are also relatively similar for large 
organizations. A case study [15] was conducted in a large company that is ongoing a lean transformation 
process. The case study showed a difficulty in integrating UX process with lean Agile development process. 
The highest challenge they identified is that UX work is not very agile. The researchers point out the need to 
reconsider UX roles for successful integration. They also emphasize on the need for good communication 
between UX designers and developers. 


2.2. Proposing evaluation techniques 

Multiple processes were proposed to enhance the integration of UX process with the development 
process. Each of them tried to address the integration from a different angle. One study [10] discussed 
a model that integrates Agile development, design thinking and lean manufacturing. The integration resulted 
in lean UX model. They discuss applying lean manufacturing guidelines to eliminate waste. This waste 
elimination is done at the cost of interacting with the users and involving them during the design process as it 
is replaced by peer review of the designs. 

Further enhancement on lean UX was proposed by a group of researchers [24]. They started by 
studying how the UX process integrates into Agile development in South African organizations. After 
identifying the commonly faced challenges they proposed a model that integrates lean UX process in Scrum 
framework. They added sprint 0 for the upfront UX work. Then the regular sprints included validating 
against the output from sprint 0, sketching, presenting the sketches for feedback from the development. 
This process gets iterated within the sprint timebox. The output from the design sprint gets delivered for 
the consecutive development sprint. 

Another research [22] proposed a model integrating the UX process and the development process. 
The proposed model was based on the unified process. They address the possibility of separating the front 
end and backend development. This is to deliver the front end needs first and postpone the backend until 
the design is mature and the usability needs are addressed. Also, on the integration one study [23] proposed 
a new work process that integrates user centered design with Scrumban. The intent is to benefit from 
the responsibility delegation and work breakdown features of Scrumban. This proposed model is aimed for 
small organizations. Scrumban roles are similar to Scrum but it utilizes the Kanban board. Organizing 
the work in Scrumban allow for the tasks to be started at anytime without being restricted to a sprint. 


2.3. Proposing a process model 

Two notable evaluation and measurements techniques for the integration were proposed. The first was 
preliminary maturity model aimed for small organization in alignment with MPS.BR, ISO18529 
and CMMI [18]. The evaluation technique provided guidelines for mature, effective integration process. It 
focuses on having the integration separated into multiple iterations with the ability to prioritize the parts that 
are more critical to the company. The second technique focused on the integration effectiveness and how 
it is measured. They worked on identifying and addressing the difficulties related to measuring 
the effectiveness [14]. After that, they proposed a metric to measure the level of integration of human 
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computer interaction activities in the overall software engineering process models and another to measure the 
product quality against its usability targets. 

The integration between software development and UX design has been an area of interest 
and multiple researchers have identified some of the issues and proposed solutions for them. The proposed 
model had a common limitation which is the lack of emphasis on UX activities related to researching 
and testing. In the following section we propose a model that aims to address this limitation. 


3. RESEARCH METHOD 

This case study was conducted by proposing a model that integrates UX workflow and Scrum 
development practices to resolve the delivery time issue. The proposed process model was applied and tested 
with a team of 15 developer, product owner, system analyst, 2 testers, 2 UX designers, and 2 user interface 
(UI) designer. The results of this team were compared before and after using the proposed process. 
The proposed model efficiency is measured in terms of raised UX related defects after release and the time to 
market. This is followed by a survey to measure the team members satisfaction level with the process. 

Before the experiment the team was following the well-known Scrum process. They started with 
adding the features as user stories to the product backlog then identifying a set of user stories to be added to 
the sprint backlog. During the sprint the development team including the UX and the UI designers take 
the stories in the sprint backlog and transform them into a working product as they see fit. This led to a large 
part of the development team, mainly the programmers and the testers setting idle at the beginning of 
the sprint with so little to work on. Also, the previous process was not ideal for the UX and UI designers as 
their work requires interacting with the users and iterating thorough the designs which would cause a delay. 

In the proposed process model this is compensated by one large research at the beginning of 
the project with a sprint dedicated to it. Then throughout the project a smaller set of testing with the users are 
done as part of the design sprint which is separated from the development sprint. The design sprint should be 
one sprint ahead of the development sprint. In this study both of the processes were implemented by the same 
team. The set of features to be designed and implemented are estimated by the team to require similar level of 
effort in terms of both design and development. 


3.1. Proposed model 

The proposed model integrates Scrum development sprint with the UX workflow through 
an extended sprint model. The extended sprint model starts with a time boxed design sprint followed by 
a time boxed with the same duration development sprint. The outputs of design sprint 1 goes into 
the development sprint | as shown in Figure 1. During development sprint 1 the design team start sprint 2 to 
work on the next set of features. Also, the planning and grooming are attended by both designers 
and developers. Towards the end of the development the designers get involved to test the final product 
and if it conforms to the defined usability requirements. 


Resea ~ 
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Figure 1. The proposed model 


3.1.1. Design sprint 

Before starting the sprint, the UX team works on conducting a largescale user research. The focus of 
this research is identifying the user’s characteristics and behaviors and the drivers behind their actions. This 
will make the research findings more likely to be beneficial in supporting a wider set of design decision and 
able to support in designing unexpected features for the same target group. In addition to conducting 
the research, the team work on building the primary sections of design system with the components that will 
be commonly used such as the submit buttons and the input. The design system is a living artifact that grows 
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and gets updated as the product grows. After this, the design sprint will begin with identifying what needs to 
be developed based on the user needs. Then, the team start the ideation to explore the problem in depth 
and identify a set of possible solutions. After that, they work on wireframing and having an initial version of 
the design to be reviewed with the development team to insure technical feasibility and available 
team capabilities. Then test the designs with the users to validate and improve them. The team iterate 
between wireframing and testing as needed within the sprint time box once the final wireframes are reached 
the teamwork on producing the user interfaces. 


3.1.2. Development sprint 

The development sprint starts with reviewing the sprint backlog which is at this step has been 
completed with the designs produced in the design sprint. Then they do the sprint planning with the help of 
the design team to clarify any ambiguities if there exist. During the sprint the development team organize 
itself and divide the tasks as they see fit. Then towards the end of the sprint they include the design team to 
check the usability of the features implemented and if there are any errors before proceeding to the review 
with the stakeholders. By the end of the sprint a review session is conducted for all interested parties. This is 
followed by the sprint retrospective meeting. During the retrospective the team identifies what went well, 
what went wrong and how to fix it in the following sprints. 


3.1.3. Ceremonies 

The process includes multiple ceremonies as shown on Table 2. These ceremonies consist of 
the common ceremonies identified in Scrum [26, 27]. Also, one additional meeting where the development 
team validate the designs and if they are implementable considering the current development team 
capabilities and timeframe. 


Table 2. The process ceremonies 








Ceremony Purpose Participants 

Sprint planning Define the goal of the sprint and create the sprint Product owner, Scrum master, design team, 
backlog representative from the development team 

Daily standup To discuss progress in terms of what has been done and The design and development team. Scrum 
what will be done. Also, if there any blockers to be master, product owner and stakeholders are 
resolved by the Scrum master optional 


Development planning After the design part of the sprint is done and the Development team, product owner, Scrum 
development is going to start, the team meet to plan master and representative from the design 


how to build the stories in the backlog team 
Backlog grooming To assess the completeness of the stories, go over the The entire Scrum team 
designs and assess the ability to implement them. 
Review Inspect what went through the sprint and plan Scrum master, development and design team. 


improvement for the next sprint. 





4. RESULTS AND DISCUSSION 

After implementing the extended process model, we collected the data regarding the completion 
states of the stories and the bugs raised from the issue tracking tool used by the team “Jira”. We can see 
from the presented results in Figure 2 that the number of reported bugs per 50 completed stories has went 
down from 23 to 6 bugs. This is due to extending the testing and including the UX designers in it which led 
to the majority of issues being identified before marking the stories as complete. Also, we can notice 
the improvement in the ratio of the stories completed and the ones moved back to the backlog after the end of 
the sprint, as the percentage of stories moved back has decreased by 75%. However, the number of the stories 
completed changed only slightly. This indicates the increased teams’ ability to estimate the number of stories 
they can complete within the sprint duration. 


Before en 
After E 


0 20 40 60 


E Reported bugs Completed stories 
Figure 2. Bugs related to UX in production 
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When it comes to the team’s satisfaction, a survey asking the team members about their satisfaction 
and how comfortable they are working with the new process model. As seen on Figure 3 the majority of 
the developers (67%) answered that they are comfortable working with the new process model. However, for 
the UI designers the survey shows they are not comfortable working in the new process model. 


12 
10 
8 
6 
4 
7 esos oll 
0 zz 
Strongly agree Agree Disagree Strongly disagree 
E UX Designer E UI Designer E Developer 
E Tester E Product owner m System analyst 


Figure 3. The team answers to "I feel comfortable working with the new process model" 


5. CONCLUSION 

During this paper, we looked into the existing work relating to the integration of UX design work 
flow with Scrum development process. We categorized the existing work into 3 groups, the first is reviews of 
what is implemented and researched, second is proposing new models and the third is proposing new 
measurements and evaluation techniques. Overall, there are challenges faced by organizations when trying to 
integrate the process. These include the nature of the activities in UX design and development and the lack of 
awareness. After that, we proposed process to integrate Scrum development and UX workflow. The process 
managed to address the problems of time and quality in design and development. However, it keeps the user 
research to the beginning which makes it only applicable for projects that do not require intensive research. 
In the future, we look to test the proposed process on a larger team over a longer period of time to insure its 
effectiveness. 
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